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I.  INTRODUCTION 


Walsh  functions  are  binary-valued,  periodic  functions  which 
form  a complete  orthogonal  set  on  the  interval  [0,1).  Because  their 
pulse-like  character  is  compatible  with  the  operation  of  digital  com- 
puters and  processors,  much  recent  interest  has  been  generated  in  the 
study  of  the  properties  and  applications  of  Walsh  functions.  The 
study  of  the  characteristics  and  capabilities  of  Walsh  functions  at 
Syracuse  University  began  in  1972.  Past  accomplishments  include  the 
formulation  of  a sampling  theorem  for  sequency-limited  waveforms,^ 
Walsh-transform  analysis  of  discrete  dyadic-invariant  systems,7  time- 

g 

domain  analysis  of  dyadic-invariant  systems,  a critical  study  of  the 

radiation  characteristics  of  a linear  array  of  short  dipoles  excited 

9 

by  Walsh-shaped  currents,  and  a clarification  of  the  interrelationships 

10 

and  transconversion  procedures  of  Paley,  Hadamard,  and  Walsh  functions. 

The  emphasis  of  the  present  grant  was  directed  toward  developing 
some  particularly  useful  applications  of  Walsh  functions  and  Walsh 
transforms.  Many  possible  areas  of  application  were  examined.  This 
report  summarizes  the  more  significant  results  obtained  under  this  grant. 
Three  new  areas  of  application  have  been  identified.  They  are:  solution 
of  difference  equations;  multidimensional  signal  processing  on  a real-time 
basis;  and  noise-error  determination  of  combinational  circuits.  In  addi- 
tion, a simple  algorithm  for  obtaining  the  sequency  vector  of  high-order 
Hadamard  transform  matrices  has  been  developed.  These  research  accomplish- 
ments, together  with  a list  of  publications,  a list  of  professional 
personnel,  and  the  reprints  of  published  papers,  comprise  this  final  tech- 
nical report. 
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I I . RESEARCH  ACCOMPLISHMENTS 


In  this  section  we  summarize  the  more  significant  research  results 
obtained  under  this  grant . 

1.  Walsh-transform  solution  of  difference  equations  - Dyadic  opera- 
tions are  fundamental  to  Walsh  functions  and  their  applications.  How- 
ever, dyadic-invariant  systems,  though  mathematically  and  conceptually 
interesting,  do  not  correspond  to  real-world  physical  systems.  In 
order  for  Walsh  functions  and  Walsh  transforms  to  be  more  useful  and 
more  effective  in  signal  processing  and  other  applications,  methods 
for  their  usage  in  analyzing  nondyadic  time-invariant  systems  must  be 
found.  It  is  essential  that  the  Walsh  transforms  for  time-shifted 
functions  be  related  to  those  before  the  shift  so  that  important  opera- 
tions such  as  time-delay  simulation,  convolution,  and  correlation  can 
be  dealt  with.  We  have  obtained  a relation  between  the  Walsh  transforms 
of  a function  subject  to  dyadic  and  nondyadic  time  displacements.  By 
defining  spectrum-conversion  matrices,  we  have  demonstrated  the  ease  of 
using  Walsh  transformation  to  solve  linear  difference  equations. 


2.  Development  of  an  algorithm  for  sequency  ordering  of  Hadamard 
functions  - Hadamard  functions,  like  Walsh  functions,  are  binary-valued 
functions  which  form  a complete  orthonormal  set  on  [0,1).  However, 
unlike  Walsh  functions,  the  order  h of  a Hadamard  function  H(h,t)  is 
not  equal  to  its  sequency,  which  is  determined  from  the  inverse  Gray 
code  of  the  bit-reverse  binary  representation  of  h^.  In  signal- 
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processing  work  it  is  desirable  that  the  rows  of  a Hadamard  matrix  be 
rearranged  in  increasing  sequency,  resulting  in  a Walsh  matrix.  Recur- 
sive relations  for  sequency  vectors  of  consecutive  orders  have  been 
obtained,  from  which  an  algorithm  can  be  devised  to  generate  the  sequency 
vector  of  a Hadamard  matrix. 

3,  Development  of  a general  two-parameter  orthogonal  transformation 
matrix  — A procedure  frequently  used  in  two-dimensional  image  processing 
is  to  scan  the  image  sequentially  in  time,  converting  it  into  a one- 
dimensional digital  signal  and  then  processing  it  in  blocks  in  the  trans- 
form domain.  However,  this  conversion  alters  the  relative  positions 

of  the  image  elements  and  hence  changes  the  character  of  the  signal.  We 
have  introduced  a two-parameter  generalized  transformation  matrix  which 
reduces  to  the  Fourier  and  Hadamard  matrices  under  special  conditions. 

It  has  been  shown  that  the  new  trnas format ion  matrix  with  appropriate 
parameters  will  preserve  the  proper  relationship  in  the  transform  do- 
main before  and  after  scanning. 

4.  Analysis  of  the  stochastic  behavior  of  digital  combinational 
circuits  — The  determination  of  the  output  behavior  of  digital  systems 
in  response  to  stochastic  inputs  has  been  a formidable  task  because  it 
cannot  be  handled  by  the  usual  linear  algebra  and  calculus.  Logical 
algebra  and  an  associated  calculus  that  is  digital  in  nature  are  re- 
quired. We  have  found  Walsh  functions  to  be  relevant  in  this  connec- 
tion. An  n-input  Boolean  function  is  expressed  as  a Walsh  series  which 


-3- 


I 


facilitates  the  analysis  of  the  statistical  error  at  the  output  of 
a digital  combinational  circuit  due  to  a signal  corrupted  by  noise. 

We  think  this  work  represents  a very  significant  contribution  to  the 
analysis  of  the  stochastic  behavior  of  digital  combinational  circuits. 
Further  work  on  this  technique  will  undoubtedly  lead  to  new  results 
for  sequential  circuits. 


III.  LIST  OF  PUBLICATIONS 


Besides  the  technical  report  on  "Paley,  Hadamard,  and  Walsh  Func- 
tions: Interrelationships  and  Trans conversions , "^  the  following  articles 
relevant  to  this  grant  were  published  during  the  eprlod  covered  by  this 
final  report. 

1.  "Time-Shift  Theorems  for  Walsh  Transforms  and  Solution  of  Difference 
Equations,"  by  D.K.  Cheng  and  J.J.  Liu,  IEEE  Transactions  on 
Electromagnetic  Compatibility,  vol.  EMC-18,  pp.  83-87,  May  1976. 

Abstract  - Several  time-shift  theorems  for  Walsh  transforms  of  func- 
tions subject  to  nondyadic  as  well  as  dyadic  time  displacements  are 
presented.  Spectrum-conversion  matrices  are  defined  and  a relation 
between  a function  with  an  ordinary  shift  and  that  with  a dyadic 
shift  is  established.  Procedures  for  solving  difference  equations 
by  Walsh  transformation  are  given. 

2.  "An  Algorithm  for  Sequency  Ordering  of  Hadamard  Functions,"  by 
D.K.  Cheng  and  J.J.  Liu,  IEEE  Transactions  on  Computers,  vol. 

C-26,  pp.  308-309,  March  1977. 

Abstract  - A simple  algorithm  is  developed  for  oofaining  the 
sequency  vector  of  high-order  Hadamard  transform  matrices  without 
the  need  for  converting  the  order  of  individual  Hadamard  functions 
to  sequency. 

3.  "A  Generalized  Orthogonal  Transformation  Matrix,"  by  D.K.  Cheng 
and  J.J.  Liu,  IEEE  Transactions  on  Computers,  vol.  C-28,  pp.  147- 
150,  February  1979. 

Abstract  - A procedure  is  described  for  generating  a two -parameter 
orthogonal  transformation  matrix  which  reduces  to  the  Fourier  and 
Hadamard  transformation  matrices  under  special  conditions.  This 
generalized  transformation  matrix  is  particularly  useful  for 
multidimensional  signal  processing  on  a real-time  basis  because 
it  preserves  a proper  relationship  in  the  transform  domain. 

4.  "Noise-Error  Determination  of  Combinational  Circuits  by  Walsh  Func- 
tions," by  A.U.  Shankar  and  D.K.  Cheng,"  IEEE  Transactions  on 
Electromagnetic  Compatibility,  vol.  EMC-21 , pp.  146-152,  May  1979. 

Abstract  - The  stochastic  behavior  of  digital  combinational  circuits 
is  analyzed  by  the  use  of  Walsh  functions.  An  n-input  Boolean  function 

la  represented  as  a Walsh  series  and  the  error  caused  by  noise  is 
measured  in  terms  of  a distance  which  is  the  fraction  of  time  that  the 
system  output  due  to  noise-corrupted  signal  differs  from  that  due  to 
signal  alone.  It  is  shown  that  the  error  can  be  expressed  as  the  sum 
of  two  parts:  one  part  depends  only  on  noise  statistics,  and  the  other 
on  both  signal  and  noise.  Some  interesting  properties  of  both  parts 
are  discussed  and  typical  examples  are  given. 
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Time-Shift  Theorems  for  Walsh  Transforms  and  Solution  of 
Difference  Equations 

DAVID  K.  CHENG  and  JAMES  J.  LIU 

Abstract — Several  lime-shift  theorems  for  Walsh  transforms  of 
functions  subject  to  nondyadic  as  well  as  dyadic  time  displacements  are 
presented.  Spectrum-conversion  matrices  are  defined  and  a relation 
between  a function  with  an  ordinary  shift  and  that  with  a dyadic  shift 
is  established.  Procedures  for  solving  difference  equations  by  Walsh 
transformation  are  given. 

Introduction 

It  is  well  known  that  a square-integrable  function  or  a periodic 
function  can  be  approximated  in  the  least  integrated-squared- 
error  sense  by  a linear  combination  of  orthogonal  basis  functions. 
When  the  set  of  basis  functions  is  "complete,”  the  original 
function  can  be  approximated  in-the-;,.ean  with  an  arbitrarily 
small  error  by  a sufficiently  large  number  of  terms.  The  most 
commonly  used  complete  orthogonal  basis  functions  in  science 
and  engineering  are,  without  a doubt,  sinusoidal  functions.  They 
lead  to  Fourier  series  and  Fourier  integrals  which  are  of  funda- 

Manuscript  received  March  18,  WS.  This  work  was  supported  in  part 
by  the  U.S.  Air  Force  Office  of  Scientific  Research. 

The  authors  are  with  the  Department  of  Electrical  and  Computer 
Engineering,  Syracuse  University,  Syracuse,  NY  13210. 


mental  importance  in  signal  representation,  system  analysis,  and 
solution  of  physical  problems. 

Sinusoidal  functions  are,  of  course,  not  the  only  class  of 
possible  basis  functions.  One  other  class  that  has  received 
considerable  attention  recently  is  the  set  of  Walsh  functions 
[1  ]—  [3 ].  Walsh  functions  are  binary-valued  periodic  functions 
which  form  a complete  orthonormal  set  on  the  interval  [0,1). 
Because  their  pulse-like  character  is  compatible  with  die  opera- 
tion of  digital  computers  and  processers,  they  have  found  many 
important  applications  in  such  areas  as  pattern  recognition, 
signal  and  image  processing,  digital  filtering,  sequency  multi- 
plexing, interferometric  spectroscopy,  etc.  [4]-  [7],  Generalized 
transform  theories  using  Walsh  functions  as  the  kernels  have 
been  developed  [8],  [9],  Pichler  [10],  [11]  has  considered  the 
formalism  for  the  use  of  Walsh-Fourier  transforms  in  linear 
system  theory.  As  the  main  advantage  of  using  Walsh  functions 
lies  in  their  binary  character,  and  as  continuous  Walsh  transforms 
are  difficult  and  cumbersome  to  evaluate,  Cheng  and  Liu  [12] 
applied  discrete  Walsh  transforms  to  the  analysis  of  dyadic- 
invariant  linear  systems.  However,  dyadic-invariant  systems, 
though  mathematically  and  conceptually  interesting,  do  not 
correspond  to  ordinary  real-world  physical  systems.  In  order  for 
Walsh  functions  and  Walsh  transforms  to  be  more  useful  and 
more  effective  in  signal  processing  and  other  applications, 
methods  for  their  usage  in  analyzing  nondyadic  time-invariant 
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systems  must  be  found.  It  is  essential  that  the  Walsh  transforms 
for  time-shifted  functions  be  related  to  those  before  the  shift  so 
that  important  operations  such  as  time-delay  simulation, 
convolution,  and  correlation  can  be  properly  dealt  with. 

This  paper  presents  several  time-shift  theorems  for  Walsh 
transforms  of  functions  subject  to  nondyadic  as  well  as  dyadic 
time  displacements.  Spectrum-conversion  matrices  are  defined 
and  a relation  between  a function  with  an  ordinary  shift  and  that 
with  a dyadic  shift  is  established.  As  a specific  application,  the 
recursive  formula  relating  the  output  to  the  input  of  a system 
described  by  a general  difference  equation  is  obtained,  and  a 
numerical  example  is  included. 

Time  shifting  in  the  Walsh  domain  was  studied  by  Brown 
[13],  who  made  use  of  the  Hadamard  matrix  instead  of  the 
Walsh  matrix.  The  emphasis  in  Brown’s  work  was  mainly  on 
Walsh-domain  applications  of  some  signal-processing  problems. 
Solution  of  difference  equations  was  not  considered. 

Walsh  Transform  of  Time-Shifted  Functions 

In  this  work  we  confine  our  attention  to  sampled  time  functions 
and  their  discrete  Walsh  spectra.  Sampled  time  functions  are 
represented  by  column  vectors.  Their  discrete  Walsh  spectra  in 
the  sequency  domain,  also  represented  by  column  vectors,  are 
obtained  by  premultiplication  with  a square  Walsh  matrix  of  the 
proper  order.  Thus  let  /(/')  denote  the  N x 1 (N  = 2 ")  time 
vector,  then  its  Walsh  spectrum  or  discrete  Walsh  transform, 
F(l),  is 

F = Wf  (1) 

where  W is  the  /V  x N Walsh  matrix  whose  rows  and  columns 
are  Walsh  vectors  ordered  in  an  increasing  sequency,  and  hence 
is  different  from  the  Hadamard  matrix.  The  inverse  relation 
of  (1)  is 

/ = W~l  F = — WF.  (2) 

N 

The  ith  element  of / can  be  written  in  a summation  form 

/(/)  = - l F(lW(l,i).  (3) 

i V i = o 

A shift  of  A units  in /will  change  the  /'th  element  to /(/  - k), 
or 

/-*(/)  = /(<  - k)  = 1 Y F(IWU,  i - k).  (4) 

N i = o 

In  matrix  form,  (4)  leads  to  the  sampled  shifted  function 

f.k  = Uw.kF)  (5) 

N 

where  W_k  is  the  Walsh  matrix  W with  its  last  k rows  moved  up 
as  the  new  first  k rows  and  the  original  first  N - k rows  each 
moved  down  k units.  W_k  can  also  be  written  as  a square  matrix 
whose  columns  are  the  Walsh  vectors  with  sequencies  from  0 to 
N — I,  each  shifted  by  k units: 

W.k  = pr_»( 0),  W_k(  1),-  • •,  W_k(l),- • .,  W_k(N  - 1)].  (6) 

Let  F_t  be  the  Walsh  spectrum  of /_*;  that  is, 

F-k  = Wf_k.  (7) 

Then,  from  (5),  we  have 

F.k  = i WW_kF  = B.kF  (8) 

/V 
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B.k  = 1 WW_k  = W~lW.k  (9) 

N 

can  be  called  the  spectrum-conversion  matrix  for  a A-unit  shift, 
which  relates  the  Walsh  spectrum  of  a sampled  function  shifted 
(nondyadically)  by  k units  to  that  of  the  sampled  function  before 
the  shift.  Equation  (8)  can  be  staled  in  the  form  of  a theorem. 

Theorem  I 

If  F is  the  discrete  Walsh  transform  of  a sampled  function  /, 
then  the  discrete  Walsh  transform  of  the  sampled  function 
shift'd  by  k units,/_t,  is  F.k  = B_kF,  where  B~k  = W~l (F_t. 

For  convenience,  let  A be  the  spectrum-conversion  matrix  for 
a 1-unit  shift;  that  is, 

a = B_,  = W-‘W_,.  (10) 

We  may  write 

3 = W~‘W_,(W-lW)  = W-'iW.^-'tW 

(11) 


Li  = w_tw-'  = 


0 0 0 
1 0 0 
0 1 
0 1 

: O 

0 


is  a unit-shift  permutation  matrix  which  is  an  identity  matrix 
with  the  last  row  moved  up  as  the  new  first  row  and  all  other 
rows  shifted  down  one  unit.  It  is  clear  that  /_,  raised  to  the  Ath 
power  will  effect  a A-unit  shift.  Hence, 

(13) 

and,  from  (9),  we  have 

B_k  = W-'W_k  = W-'iW.fl-'jW 

= w~iiv_xw 

= (W-'l^Wtw-'L.W)- ■ (W-'l-tW) 

= W1.  (14) 

Equation  (14)  enables  us  to  state  the  following  theorem. 
Theorem  2 

The  spectrum-conversion  matrix  for  a A-unit  shift  is  equal  to 
the  Ath  power  of  the  spectrum-conversion  matrix  for  a 1-unit 
shift. 

We  now  illustrate  the  use  of  the  spectrum-conversion  matrix 
for  finding  the  Walsh  transform  of  a shifted  sampled  time  func- 
tion by  an  example. 

Example  1:  A sampled  time  function  is  represented  by  the 
column  vector 


(8) 
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Determine  the  Walsh  transform  of  the  shifted  time  function  In  a matrix  form,  (19)  leads  to 

Ri  - 1). 

Solution:  We  can  find  the  desired  discrete  Walsh  transform 
F_  | in  two  ways. 

a)  By  f_,  = rr/_, 


F©j  — 

= ?jF 


(20) 


F-t  = IT/-, 


-l  - 


-l 


21 

1 

-9 

-5 

-3 

5 

-1 

-1 


(16) 


b)  By  F_ , = AF , where  .4  is  obtained  from  (11)  and  F = Wf 

F 


1 

0 

0 

0 

0 

0 

0 

0 

' 21' 

0 

i 

i 

0 

0 

-i 

i 

0 

3 

0 

-i 

i 

0 

0 

i 

i 

0 

-7 

0 

0 

0 

0 

1 

0 

0 

0 

3 

0 

0 

0 

-l 

0 

0 

0 

0 

-5 

0 

-i 

-i 

0 

0 

-i 

i 

0 

-7 

0 

-i 

i 

0 

0 

-i 

-i 

0 

-1 

0 

0 

0 

0 

0 

0 

0 

-1 

1 

= Y WUO/OW/J). 
1 = 0 


where  Cj  is  a diagonal  square  matrix  with  elements  W(jJ), 
I = 0, 1 , • • • , N - 1 in  the  diagonal 


(17) 


wUfi) 


o 


m/.D 


O 


W(j,  N - 1) 


(21) 


Analogously  to  5_*  in  (8),  Cj  is  the  spectrum-conversion  matrix 
for  a /-unit  dyadic  shift,  which  relates  the  Walsh  transform  of  a 
sampled  function  shifted  dyadically  by  j units  to  that  of  the 
sampled  function  before  the  shift. 

Theorem  3 

If  F is  the  discrete  Walsh  transform  of  a sampled  function  /, 
then  the  discrete  Walsh  transform  of  the  sampled  function 
shifted  dyadically  by  j units,  /ej,  is  F(bi  - FjF,  where  is  a 
diagonal  matrix  with  elements  W(j,l),  l = 0,1,-  ■ •,  N - 1 in  the 
diagonal. 

It  is  clear  that  the  matrix  ?j  possesses  properties  similar  to 
those  of  Walsh  functions.  In  particular, 


FjCk  — €j$k 


(22) 


and  there  does  not  appear  to  be  a simple  way  to  derive  Cj 
from  C j. 

Example  2:  For  the  sampled  time  function  /(i)  given  in  (15) 
find  the  Walsh  transform  of  the  dyadically  shifted  time  function 

f(i  0 1).  _ _ 

Solution:  We  can  obtain  Fffil  either  from  PF/ei  or  from  T,F. 
a)  From  PP/ffil.  We  first  derive /(/  © 1)  = /©i  from  the  given 
hi)  in  05) 


21 
1 

-9 
-5 
-3 
5 

-1 
-1 

Of  course  the  results  in  (16)  and  (17)  are  the  same.  Comparing 
the  two  column  vectors  in  (17),  it  is  obvious  that  F_,  cannot  be 
obtained  from  F by  a simple  rotation  of  elements. 

Walsh  Transform  of  Dyadically  Shifted  Functions 

From  (1),  the  /th  element  of  Fean  be  written  in  a summation 
form 

F(l)  = Y W(l,i)hi).  (13) 

1 = 0 

The  /th  element  of  the  Walsh  transform  of  / dyadically  shifted 
by  j units  is 

F®//)  = Y m,i)fu  0 J) 

1*0 

= Y I ® ;')/(/) 

/ = 0 


/©i  - 


(23) 


With  (23)  we  find 
F ®i  = ^Vffii 


-1  - 
-1  - 
-I 
-1 
1 - 
1 - 


(19) 


21 

3 

-7 

3 

5 

7 

1 

-1 


(24) 
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b)  From  C,F.  Here  we  need  to  know  F = Wf  which  has  been 
found  as  the  first  column  matrix  in  (17).  We  have 


formula  of  the  system  governed  by  the  difference  equation.  Both 
procedures  are  illustrated  in  the  following  example. 


^®i  — 

n 


o 


o 


-i 


-i 


211 

3 

-7 

3 

-5 

-7 

-1 

lj 

Example  3 

Solve  the  following  difference  equation : 

2y(n  - 2)  + 5 y(n  - 1)  + 2 y(n)  = x(n).  (30) 

Solution:  a)  To  solve  (30),  we  write  it  in  vector  form  using 
column  vectors  to  represent  discrete  sampled  functions 

2y-2  + 5.p_i  + 2y  = x.  (31) 

If  F and  X denote  the  discrete  Walsh  transforms  of  y and  x, 
respectively,  then  the  Walsh  transformation  of  (31)  yields,  in 
view  of  theorems  1 and  2, 


(25) 


(2  A2  + 5 A + 2l)7  = X 


where  A has  been  given  in  (1 1).  Consequently, 


F = (2A2  + 5A  + 2/r‘JF  = HR 


(32) 


(33) 


where  C , is  obtained  from  (21). 

Relations  Between  Dyadic  Shift  and  Ordinary  Shift 

By  combining  (8)  and  (20),  a relation  between  the  Walsh 
spectrum  of  a dyadicallv  shifted  function  and  that  of  a non- 
dyadically  shifted  function  can  be  easily  established 

Fm  = A/_k  (26) 

where 

Dk  = CkS.k-1  = Cj-\  (27) 

The  inverse  Walsh  transform  of  (26)  then  relates  a dyadically 
shifted  sampled  function  with  the  sampled  function  shifted  in  the 
conventional  manner  by  the  same  number  of  units 

/©*  = W^DkWf_k.  (28) 

Equations  (26)  and  (28)  will  prove  to  be  useful  in  Walsh  trans- 
form analysis  of  linear  systems.  The  inverse  relation  of  (28) 
follows  directly: 

/-*  = W-'Dk-'Wfm.  (29) 

Solution  of  Difference  Equations 

With  the  aid  of  theorems  1 and  2,  we  can  determine  the 
solution  of  a difference  equation  by  Walsh  transformation  in  a 
straightforward  manner.  Moreover,  we  can  obtain  the  recursive 


with 

ff  = (2  A2  + SR  + 2 Jr'  (34) 

which  is  effectively  the  transfer  function  in  the  sequency  domain. 
The  solution  of  the  difference  equation  is  then 

y = W-'Y  = W-lf U 

= W~'fiWx.  (35) 

b)  To  obtain  a recursive  formula  in  the  following  form 

y(n)  = a0x(n)  + a,x(n  - 1)  + •••  + - N + 1)  (36) 

where  N = 2m  and  the  coefficients  aQ,au ■ ■ ■. a , are  to  be  found, 
we  observe  that  it  is  tantamount  to  writing  the  transfer  function 
H in  (34)  as 

H = a0!  + a,R  + ■ ■ ■ + as,lAs~ 1 (37) 

since  the  Walsh  transformation  of  (36)  should  lead  to  (33).  Pre- 
and  postmultiplying  (37)  by  fV  and  W~l,  respectively,  we 
obtain,  by  virtue  of  (1 1), 

W’HW  ~ 1 = a0I  + + •••  + (38) 

The  coefficients  a0,a ■ • ,av  can  be  determined  easily  from  (38) 
for  any  given  U by  inspection. 

For  the  present  example,  A has  been  given  in  (17)  for  N = 8. 
From  (34),  we  have 


.III 

0 

0 

0 

0 

0 

0 

0 

0 

0.029 

-0.029 

0 

0 

— 0.147 

-0.147 

0 

0 

0.029 

0.029 

0 

0 

-0.147 

0.147 

0 

0 

0 

0 

0 

-0.200 

0 

0 

0 

0 

0 

0 

0.200 

0 

0 

0 

0 

0 

-0.147 

0.147 

0 

0 

-0.265 

-0.265 

0 

0 

0.147 

0.147 

0 

0 

0.265 

-0.265 

0 

0 

0 

0 

0 

0 

0 

0 

-1 

(39) 
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I* 


Pre-  and  postmultiplying  Ft  in  (39)  by  W and  W *,  respectively, and  observing  (38),  we  obtain 


-0.170 

0.336 

-0.170 

0.089 

-0.052 

0.042 

-0.052 

0.089 

0.089 

-0.170 

0.336  - 

-0.170 

0.089 

-0.052 

0.042 

-0.052 

-0.052 

0.089 

-0.170 

0.336 

-0.170 

0.089 

-0.052 

0.042 

0.042 

-0.052 

0.089  - 

-0.170 

0.336 

-0.170 

0.089 

-0.052 

-0.052 

0.042 

-0.052 

0.089 

-0.170 

0.336 

-0.170 

0.089 

0.089 

-0.052 

0.042  - 

-0.052 

0.089 

-0.170 

0.336 

-0.  i70 

-0.170 

0.089 

-0.052 

0.042 

-0.052 

0.089 

-0.170 

0.336 

0.336 

-0.170 

0.089 

- 0.052 

0.042 

-0.052 

0.089 

-0.170 

0.170/  -1 

o 

o 

00 

v© 

r- 

- 0.052/. 

2 + 0.042/.  3 - 

0.052/_4 

+ 0.089/. 3 - 0.170/_6  + 0.336/_7  (40) 


solving  difference  equations  by  Walsh  transformation  have  been 
shown. 
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which  is  in  the  form  of  (38).  We  can  then  write  Ft  in  (34)  in  the 
form  of  (37) 

Tt  = -0.170/  + 0.089,4  - 0.052.4 2 + 0.042.4 3 

- 0.052,?4  + 0.089.4 5 - 0.I70.46  + 0.336.47.  (41) 

Since  ? = RX,  as  defined  in  (33),  we  have  the  following  recur- 
sive formula  for  the  given  system: 

y = - 0.170*  + 0.089*.,  - 0.052*_2  + 0.042*.  3 

- 0.052*.*  + 0.089*.,  - 0. 170*_6  + 0.336*.,.  (42) 

Equation  (42)  expresses  the  output  y as  a linear  combination  of 
the  input  * shifted  by  various  amounts.  It  would  be  easy  to 
devise  a hardware  implementation  of  (42)  as  the  solution  of  the 
difference  equation  given  in  (31). 

Conclusion 

Time-shift  theorems  for  Walsh  transforms  of  functions 
subject  to  nondyadic  as  well  as  dyadic  time  displacements  have 
been  presented.  Spectrum-conversion  matrices  have  been 
defined  and  a relation  between  a function  with  an  ordinary  shift 
and  that  with  a dyadic  shift  has  been  established.  Methods  for 
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( h b = (6„- 1 b„  ....  H>b ,1. 


then  its  hit  reverse  is 


(h)  - ib\b  > • • • b„-  >bn-  i ) 


[;  -:] 


An  Algorithm  for  Sequency  Ordering  of  Hadamard 
Functions 

DAVID  K.  CHENG  and  JAMES  J.  LIU 

Abstract  A simple  algorithm  is  developed  for  obtaining  the 
sequenev  vector  of  high-order  Hadamard  transform  matrices 
without  the  need  for  converting  the  order  of  individual  Hadamard 
functions  to  sequency. 

Index  Terms  Hadamard  functions,  sequency  (ordering),  Walsh 
functions. 


Hadamard  functions  [!|.  like  Walsh  functions  |2|,  are  binary  valued 
functions  which  form  a complete  orthonormal  set  on  |(l,l).  However, 
unlike  Walsh  functions,  the  order  h of  a Hadamard  function  Hth.t  I is 
not  equal  to  its  sequenev.  which  is  defined  as  the  number  of  zero  crossings 
in  the  unit  interval.  It  is  known  that  the  sequency  of  a Hadamard  function 
can  lie  determined  by  finding  the  inverse  Gray  code  of  the  bit  reverse  of 
the  binary  representation  of  its  order  |.’1|,  [ t|.  Concisely,  if  the  binary  form 
of  h is 


Hadamard  Transform  Matrix  Sequency  Vector 

1 i i i i i i n ro] 

1-11-11-11-1  7 

1 1-1-1  I 1-1-1  .1 

H,  = 1 -1  -1  1 1 -1  -1  1 3,  = 4 (71 

1111-1-1-1-1  1 

1-11-1-11-11  6 

1 I -1  -I  -I  -1  1 1 2 

.1  -1-1  1-1  1 1 -1J  L5_ 

where  the  sequency  ordering  is  expressed  as  a column  vector  for  conve 
nience.  If  the  rows  of  the  Hadamard  matrix  are  rearranged  in  increasing 
sequency,  it  becomes  a Walsh  matrix  which  finds  important  applications 
in  image  processing  and  other  areas.  The  question  arises:  what  are  the 
sequency  vectors  of  the  16  X 16  Hadamard  matrix  and  of  32  X 32  and 
higher  order  Hadamard  matrices?  The  answer  to  this  question  is  not 
obvious  and  the  bit -reverse  inverse  (irav  code  procedure  applied  to  each 
row  of  the  Hadamard  matrix  is  tedious.  In  the  following  we  develop  an 
algorithm  for  obtaining  the  entire  sequency  vector  by  inspection 
Assertion:  Let  i he  the  sequency  vector  for  the  2"  1 X 2"  1 
Hadamard  matrix: 


Then  the  sequenev  vector  Sn  for  the  2"  X 2'  Hadamard  matrix  is 

. _ri  l 


The  inverse  Gray  code  of  lh  b in  (21  is 

(ti’)j  * (C|C_>  • • • < 


c,=  £ bj  (4) 

i * i 

where  2 denotes  a dyadic  or  logical  summation.  («  )•.>  is  the  binary  form 
of  the  sequency  of  Hih.t ) _ 

The  Hadamard  matrix  H„  transforms  a set  of  N - 2r'  sampled  data 
in  the  time  domain  to  a discrete  set  of  N values  in  the  sequency  domain. 
The/i*h  row  of  Rn  represents  the  values  of  the  Hadamard  function  H(h,t) 
where  h varies  from  0 to  .V  — 1 . The  use  of  Hadamard  transformation  is 
convenient  because  of  the  ease  of  generation  of  a Hadamard  matrix  of 
an  arbitrary  order  from  the  basic  Hadamard  matrix 


dlk  = c*  (lot 

d,k+\  = 12"  - 11  - c*.  k = 0,1.  • .2"  1 - 1.  (Ill 

This  assertion  can  be  expressed  more  concisely  as  S„  V2k ) = S,  ,(A  > and 

Sn(2k  4-  1)  = (2n  - n-Sn.,(kl 

Proof  We  shall  prove  the  two  recursive  formulas  (101  and  (111  sep 
aratelv. 

i ) d 2k  s Ck  _ 

Let  the  binary  representation  of  the  sequenev  order  k of  S’.  be 

(k  )j  » (<j„-  i a„-  > • • • dja  i );  (121 

then  its  bit  -reverse  (k ) ■ is 

(k b = (a  ifl-j  • • • a„.  jd„_ 1 1 (131 

From  (141  the  binary  representation  of  sequency  order  2k  in  S,  is  seen 
to  be 


(2 k b = (n„  |0„  . • • • a -a  |01 


by  the  following  recursive  formula: 

Hn\+ni  ~ ^h|  ® //fi'2  16 1 

where  ® denotes  a Kronecker  product  [3|-(5|.  In  particular,  for  n = 3,  the 
8X8  Hadamard  matrix  and  the  sequency  ordering  of  its  rows  are.  re 
spectively. 
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whose  bit -reverse  is 

(2fc)  = tOaiflj  • • • a„  _»u r»  — i > (151 

It  is  evident  that  the  inverse  Gray  code  of  (2*  > in  (151  is  numerically  the 
same  as  that  of  (k)  ■ in  (13).  Hence.  cb*  = c*. 
ii)  d-2k ♦ i * (2n  - 1 ) - c* 

Because  of  (6).  the  above  relation  is  equivalent  to 

d jk  4-  d-ik  ♦ i * 2 n “ 1.  (16) 

From  ( 10).  we  can  write  immediately 

(2 k + D’j  * (a„  - ian-2  • • • a*a  \ 1 > (17) 


(2k  + lb”  (lain.-  • • • d„-  .*0,,- 1)  (18) 

Let  ( 0/ 1 / -2  •••/,•••  ln  i)  and  ( •••/’,  •••/„-!  I be,  respectb  » 
inverse  Grav  code  of  (2k ) in  (15)  and  (2k  + 1 » in  (18).  W e have.  In  <i 
(4). 
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rOHRKSPoSDKNt  k 


i * 1 ,2,  • • • .n  — 1 


/ * I # a i ® a 


i * 1 .2,  • • • ,n  - 1 


where  # denotes  dyadic  or  logical  addition.  It  is  obvious  from  * 19)  and 
(20) that 

/,+/,*  1.  (21) 


•••/«-»)  ♦ (if,/,  • ••/„  ,) 

* (1  1 1 •••  11  * 2"  - 1 (22) 

and  i Id)  follows  directly.  The  proof  of  our  assertion  is  now  complete 
An  algorithm  based  on  recursive  formulas  1 10)  and  (11)  can  l»e  devised 
to  generate  S„  and  S„  , In  order  to  find  and  S knowing  £ in  (7).  we 
note  that,  forjhe  16  X 16  Hadamard  matrix,  n * 4 and  2"  - I - 15.  The 
transpose  of  S4  can  lie  written  down  immediately  by  inspection: 

= |0  15  7 8 3 12  4 11  1 14  6 9 2 13  5 10|.  (23) 

Similarly,  for  the  32  X 32  Hadamard  matrix,  n * 5.  2"  - 1 = 31.  and  the 
transpose  of  the  sequency  vector  is 

|0  31  15  16  7 24  8 23  3 28  12  19  4 27  11  20 

1 30  14  17  6 25  9 22  2 29  13  18  5 26  10  21|.  (24) 

Each  number  in  (231  and  (241  represents  the  sequency  of  the  cor  re 
sponding  Hadamard  function  in  the  Hadamard  matrix. 
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A Generalized  Orthogonal  Transformation  Matrix 

DAVID  K CHENG  and  JAMES  J LIU 

Abstract  A procedure  is  described  for  generating  a two- 
parameter  orthogonal  transformation  matrix  which  reduces  to  the 
Fourier  and  Hadamard  transformation  matrices  under  special  condi- 
tions. This  generalized  transformation  matrix  is  particularly  useful 
for  multidimensional  signal  processing  on  a real-time  basis  because  it 
preserves  a proper  relationship  in  the  transform  domain. 

Index  Terms  Fourier  transform,  Hadamard  transform,  ortho- 
gonal transform,  raster  scan,  signal  processing. 
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Intkoih  cth>n 

A procedure  frequently  used  in  two-dimensional  image  proces- 
sing is  to  scan  the  image  sequentially  in  time  (raster  scan),  con- 
verting it  into  a one-dimensional  digital  signal  and  then 
processing  it  in  blocks  in  the  transform  domain  ( 1 ],  (2)  The  scan- 
ning process,  in  eflect.  transmits  a two-dimensional  matrix  in  the 
form  ol  a one-dimensional  column  matrix  (vector).  For  example, 
the  matrix  signal  or  image 


u.l 

M 

(1) 

G 

gJ 

as  x 

whose 

transposition. 

v\  is 

>2  / 

S Cl 

Cl  o,] 

(2) 

However,  this  conversion  alters  the  relative  positions  ol  the  ele- 
ments. and  the  autocorrelation  of  x [or  of  in  (2)]  is  obviously 
not  the  same  as  that  of  x in  (1 ) It  is  seen  that,  in  x,  b,  is  close  ton, 
and  < , whereas,  in  x or  x'.  />,  is  quite  far  from  «|  and  <■,  but  is  now 
close  to  u,  Hence,  the  scanning  process  changes  the  character  of 
the  original  image,  and  processing  in  the  transform  domain  after 
scanning  may  not  yield  the  desired  results 
This  correspondence  introduces  a two-parameter  generalized 
transformation  matrix  which  reduces  to  the  Fourier  and  Hada- 
mard  transformation  matrices  under  special  conditions  It  is 
structured  on  the  m-ary  number  system  usjng  m-adic  (modulo  m) 
operations  The  generalized  matrix  can  be  generated  from  a basic 
core  matrix  in  a relatively  simple  manner  It  will  be  shown  that  the 
new  transformation  matrix  with  appropriate  parameters  will 
preserve  the  proper  relationship  in  the  transform  domain  before 
and  after  scanning  and  that  m-adic  operations  based  on  the  m-ary 
number  system  are  inherently  relevant  in  .the  processing  of  m x m 
matrix  signals  Ahmed  ft  ul  [3]  discussed  the  generation  of  a 
family  of  discrete  orthogonal  transforms  for  a given  periodic  data 
sequence  Their  emphasis  was  in  factoring  these  transform 
matrices  into  a product  of  sparse  matrices  and  was  not  concerned 
with  preserving  the  character  of  the  scanned  image 

Prft  iminarifs 
Consider  a simple  4x4  matrix  signal 

'2  1 3 4 

v = >230 

241'| 

.3  I 0 3. 

Its  two-dimensional  discrete  Fourier  transform.  X t,  is  easily  ob- 
tained [4],  (5)  We  have 


X,=  Fx  t-xp  = 2+>  -6  + >11  2- >3  2 -j 

5 -1  -3  -I 

.2  -j  2+>  2 + >3  -6 ->11 

where  the  4x4  Fourier  transformation  matnx  F4  is 

i i i r 

f i -j  -i  +y 

i -i  i -i 

.1  +y  -i  -> 
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When  raster  scan  is  used  to  convert  x in  (3)  to  a one-dimensional 
16  x I column  vector  x,  a 16  x 16  transformation  matrix  Fl6  is 
conventionally  used  to  obtain  its  Fourier  transform  X r To  save 
space,  we  write 

X',  = {F  |6x['  = x'f16 

= [31.  0.058  ->2  935.  ->3.828,  - 1.141  +>1.539, 

1.  2.555  + >12.61.  ->1  828.  - 1.473  + >0  136. 

- 1.  - 1473  ->0.136.  >1.828.  2.255  - >12  61, 

1,  — 1.141  - >1.539.  >3.828.  0058  +>2  935],  (6) 


1 1 

1 eJ" 8 
1 e"4 


and 

= [2  1 34  1 23024  1 13  1 0 3} 

(X) 

Obviously.  X'f  in  (6).  when  rearranged  in  a two-dimensional  form, 
is  not  the  same  as  X / in  (4)  We  seek  a new  orthogonal  transform 
matrix  which  will  alleviate  this  discrepancy 

Thf  Corf  Matrix 

In  general,  a two-dimensional  image  signal  x may  comprise 
m x m elements:  that  is.  there  may  be  m rows  each  containing  m 
elements  Raster  scanning  makes  the  first  element  of  the  second 
row  (which  is  spatially  close  to  the  first  element  of  the  first  row  ) 
the  (m  + 1 )th  element  Conversely  , the  reconstruction  of  an  image 
from  a one-dimensional  digital  signal  puts  the  ( m + 1 )th  element 
at  the  head  of  the  second  row  which  is  close  to  the  first  element  of 
the  first  row  This  suggests  a similarity  with  the  structure  of  an 
m-ary  number  system 

We  define  an  m x m basic  orthogonal  transformation  matnx  as 
follows: 


Cm,  = 1 


t,  ftm  i i2*  * 
, Jim  1 I4r  h 


uM.i  is  an  m-ary  matrix  of  the  first  order  and  it  is  easy  to  verify 
that  (on  a matrix  denotes  the  transpose  complex  conjugate,  or 
adjoint,  of  the  matnx) 

<5-..6:.i  = m/.  (10) 

where  /’  is  an  m x m identity  matnx  We  shall  designate  the  ortho- 
gonal G„  | as  the  core  matrix  We  note  here  that  m is  not  restricted 
to  be  an  integral  power  of  2 

Thf  Generalized  Transformation  Matrix 

The  core  matnx  Gm  , may  be  extended  to  higher  orders  by 
Kroneckcr  multiplication  [4],  (6): 

= 6«.,  i ® C„,|.  (II) 


HI) 
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where  Gm.„  is  an  m-ary  matnx  of  the  nth  order  It  has  a dimension 
m”  x m"  and  is  also  orthogonal  We  note  that  ,(n  = 1)  is  a 
Fourier  matnx  and  that  G2  ,(m  = 2)  is  a Hadamard  matnx 
Hence,  (/„„  may  be  called  a generalized  transformation  matrix 
which  reduces  to  Fourier  and  Hadamard  matnces  for  particular 
values  of  the  parameters  m and  n.  It  is  important  to  observe  that, 
in  general. 


and 


= Fm,  * Gm 


G 2».  | ^ G 2,k  = 


(12) 


(13) 


A.i 

C4.i 

Gi. , 

-jGi.i 

-Gi., 

jGi.i 

^4,1 

-c4. , 

Gi. , 

-Gi. 

<54  . « 

jGi., 

-<54., 

-jGi.  1 

where  Hlx  is  the  Hadamard  matrix  of  the  2*th  order  [6], 

For  the  4x4  matrix  signal  in  (3),  we  transform  it  by  Gi.,.  Since 
G4,i  is  the  same  as  F4  in  (5),  we  obtain  the  same  result  in  the 
transform  domain;  that  is,  X,  = <54[  xGi.,,  which  equals  the  X , 
in  (4).  With  raster  scan,  the  resulting  v should  be  transformed  by 
the  16  x 16  matrix  G4  2; 


Gi. 2 — G4  | ® G4  | — 


(14) 

It  is  readily  shown  that 
X,  = G4  2 v = 

[31,  I -1.  1,  2+j.  -6 +>11,  2 -A  2->, 
5.-1,  -3,  -1.  2-7,  2+7,  2+>3,  — 6 — >11]. 

(15) 

which  is  the  same  cs  the  one-dimensional  scanned  version  of  X,  or 
of  X / in  (4).  The  proper  relationship  in  the  transform  domain  for 
the  two-dimensional  signal  is  therefore  preserved  for  the  one- 
dimensional  signal  after  scanning. 

CoKKEl  ATION  Ft  NOTIONS 

We  have  seen  from  (II)  that  a generalized  transformation 
matnx  of  a high  order  can  be  generated  from  the  core  matrix  by 
Kronecker  multiplication.  The  core  matrix  is  basically  built  on  an 
m-ary  number  system  The  propriety  of  using  m-adic  arithmetic  in 
dealing  with  m x m two-dimensional  images  can  be  further 
demonstrated  by  considering  the  correlation  functions. 

The  (i'i,  /2)th  element  of  the  cross-correlation  matrix  of  two 
m x m signals  v and  y can  be  written  as 

HI  - 1 HI  I 

«2)=  £ £ x(i[  ©7',,  i2  ® j2) 

h =0  /;  = 0 


■y’OWr); 


0 < i i,  i2  < m - 1 

0<ji,ji  < m - 1 


where  • denotes  complex  conjugate.  The  symbol  © represents  an 
m-adic  (or  modulo  m with  no  carry)  addition.  Raster  scanning 
converts  the  two-dimensional  m x m matrices  x and  y into  one- 
dimensional m2  x I vectors  v and  y.  For  example,  the  (/,.  i2)th 
element  in  v will  appear  as  the  ith  element  in  x,  where 


/ = /, m + i2,  0 < i'i,  i2  < m - 1. 

Rxy(i i,  ij)  in  (16)  therefore  can  be  rewritten  as 


m - I m 1 

#«>(')=  £ £ *{(<!  ©> i)m  + (i2  © h)}  y*{jim  +ji) 

J I *0  >2=0 

= "£l-*(i  © i)y*(il  (18) 

1 = 0 

which  is  exactly  the  element  in  the  one-dimensional  Rxy  corre- 
sponding to  the  (i|,  i2)th  element  in  the  two-dimensional  Rxy 
shown  in  (16). 

The  second-order  generalized  transformation  matnx  Gm  l must 
be  used  on  Rxy  to  obtain  the  m2  x 1 power-density  vector  Sxy: 

(19) 

where  X,  V*  is  a termwise  multiplication  [7]  S in  (19)  rear- 
ranged as  m x m matrix  will  be  the  same  as 


= GmlRxy  = X, 


5xy  — RxyGmA. 


(20) 


The  same  conclusion  cannot  be  drawn  if  Gm,2  and  Gm  , are 
replaced  by  Fm,  and  Fm,  respectively.  As  a consequence,  a 
distorted  power-density  spectrum  would  be  obtained  if  the  con- 
ventional Fourier  or  Hadamard  transformation  matnx  is  used 
with  a scanned  signal. 

For  the  given  4x4  matnx  signal  x in  (3).  the  autocorrelation 
matrix  Rx  is,  from  (16), 


S,= 


'85 

60 

44 

60' 

58 

40 

58 

78 

40 

62 

80 

62 

.58 

78 

58 

40. 

x is,  from 

(20). 

961 

I 

I 

1 

5 

157 

13 

5 

25 

1 

9 

1 

5 

5 

13 

157 

(21) 


(22) 


Inspection  of  (15)and  (22)  reveals  immediately  that  the  relation  in 
(19)  is  satisfied. 

If  quadri-adic  addition  is  not  used,  the  transposed  autocorrela- 
tion vector  of  the  scanned  v would  be 

R'i  = [85,  54.  46,  78.  58,  40.  74,  68. 

40,  68,  74,  40,  58.  18.  46.  54],  (23) 

which  bears  no  simple  relation  with  Rx  in  (21).  Furthermore,  the 
discrete  Fourier  transform  of  R'x  in  (23),  after  rearrangement,  is 


£ = 


(16) 


961  8.617  14  66  3 668 

I 165.5  3.343  2.187 

1 2.187  3.343  165.5 

1 3.668  14.66  8.617 


(24) 


Compared  with  J,  in  (22),  S',  in  (24)  is  obviously  incorrect;  so  also 
will  be  the  results  of  subsequent  steps  of  signal  processing  On  the 
other  hand,  when  the  generalized  matrix  54  2.  derived  in  accor- 
dance with  (14),  is  used  to  transform  the  scanned  version,  R,,  of 
R,  in  (21),  we  obtain 


(12) 


— Gi  2Rx, 


(25) 


which,  when  rearranged  in  a two-dimensional  form,  restores  the 
power-density  matrix  Sx  in  (22). 
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Noise-Error  Determination  of  Combinational  Circuits 

by  Walsh  Functions 


A.  UDAYA  SHANKAR  and  DAVID  K.  CHENG,  fellow,  ieee 


Abstract- The  stochastic  behavior  of  digital  combinational  circuits  is 
analyzed  by  the  use  of  Walsh  functions.  An  n-input  Boolean  function  is 
represented  as  a Walsh  series  and  the  error  caused  by  noise  is  measured 
in  terms  of  a distance  which  is  the  fraction  of  the  time  that  the  system 
output  due  to  noise -corrupted  signal  differs  from  that  due  to  signal 
alone.  It  is  shown  that  the  error  can  be  expressed  as  the  sum  of  two 
parts:  one  part  depends  only  on  noise  statistics,  and  the  other  on  both 
signal  and  noise.  Some  interesting  properties  of  both  parts  are  discussed 
and  typical  examples  are  given. 

Key  Words:  Noise  error,  digital  combinational  circuits,  Walsh 
functions. 


I.  INTRODUCTION 

THE  OUTPUT  behavior  of  linear  (and  some  nonlinear) 
analog  systems  in  response  to  stochastic  inputs  can  be 
determined  in  a large  number  of  cases.  However,  no  such 
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comparable  facility  exists  for  digital  systems,  such  as  those 
employing  threshold-type  devices  and  discrete-valued  wave- 
forms. Given  input  statistics  and  digital-system  transformations, 
it  is,  in  general,  a formidable  task  to  obtain  the  output  statis- 
tics. An  obvious  reason  for  this  difficulty  is  that  digital-device 
(such  as  a transistor-transistor  logic  (TTL)  gate)  models  are  not 
linear  RLC  models  and  cannot  be  handled  by  the  usual  linear 
algebra  and  calculus.  Logical  algebra  and  an  associated  calculus 
that  is  digital  in  nature  are  required  [1],  In  this  connection, 
Walsh  functions  have  been  found  to  be  relevant  (2] -(5] . This 
paper  expresses  an  n-input  Boolean  function  as  a Walsh  series 
and  defines  the  error  at  the  output  of  a combinational  circuit 
caused  by  noise  as  the  distance  between  the  responses  to  the 
signal  and  to  the  noise-corrupted  signal  inputs.  The  use  of 
Walsh  functions  appears  natural  here  and  does,  in  fact,  facili- 
tate the  computation  of  the  system  error  [6) , [7] . 

It  will  be  shown  that  the  error  can  be  obtained  as  the  sum 
of  two  parts:  one  part  depends  on  noise  statistics  only,  and  the 
other  depends  on  the  characteristics  of  both  signal  and  noise. 
For  independent  and  identically  distributed  noise  processes. 
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the  first  part  is  invariant  over  each  of  certain  equivalence 
classes  of  Boolean  functions.  Under  certain  conditions  of  noise 
and  signal-component  processes,  the  system  error  is  expressible 
as  a polynomial  function  of  the  expected  values  of  signal  and 
of  noise.  Some  interesting  properties  of  the  error  polynomial 
will  be  discussed.  The  Boolean  functions  of  two  combinational 
circuits  are  studied,  and  the  system  errors  are  computed  and 
plotted  for  various  statistics  of  signal  and  noise. 


BINARY 

VECTOR  INPUT 


X j o- 


X e VN  OR  Dn 

Fig.  1.  Schematic  diagram  of  an  /[-input  combinational  circuit. 


N-INPUT 

COMBINATIONAL 

CIRCUIT,  S 


BINARY  OUTPUT 

S(x)  e <0,1> 


II.  PRELIMINARY  CONSIDERATIONS 

Any  n-input  combinational  circuit  S can  be  represented  by 
a Boolean  function  that  maps  every  binary  n-tuple  to  either  0 
or  1 . Let  the  set  of  all  binary  n-tuples  be  denoted  by  Vn.  Then 

Vn  = *„-2.  •"  *o  > : *i  S {0,  1}, 

forO</'<n}.  (1) 

Since  an  n-tuple  can  be  considered  as  a vector,  it  is  convenient 
to  denote  <*„_!,  x„_2,  x0 > by  x.  Let  x stand  for  the 
integer  whose  binary  representation  is  x;  we  have 

x = £ (2) 

;= o 

Equation  (7)  establishes  an  equivalence  between  {0,  1,  2,  — , 
2"  - 1},  denoted  by  Dn,  and  Vn  in  (1).  Any  function  or 
operation  defined  on  Vn  is  thus  also  defined  on  Dn.  Fig.  1 
shows  a schematic  diagram  of  an  n-input  combinational  circuit 
with  a single  binary  output. 

Dyadic  operations  are  fundamental  to  Walsh  functions  and 
their  applications.  Dyadic  addition,  denoted  by  ® (on  K„,  and 
hence  on  Dn),  is  defined  as  follows.  For  any  x andy  in  Vn, 

X®  J = <X„_1  9yn_1,xn- 2 ®yn- 2.  ■"•x0  ®.To  >e  K 

(3) 

where 

0 ® 0 = 1 ® 1 = 0 (3a) 

and 

0®  1 = 1 ®0  = 1.  (3b) 


as 


fs  =Ds[Y(r),  XN(r)].  (4) 

A more  precise  definition  for  £s  will  be  given  later. 

We  assume  that  the  noise  is  also  a binary  process  N(t)  = 
{(Af„_1(r),  Vn_2(r),  N0(t))£  Vn:  t £ T]  and  is  added  to 

X(t)  dyadically  to  yield 

J„(r)  = J(f)®AT(r).  (5) 

The  dyadic  addition  in  (5)  is  appropriate  inasmuch  as  a com- 
bined input  digit  is  in  error  if,  and  only  if,  the  corresponding 
noise  digit  is  1 . Consequently,  Walsh  functions  can  be  used  to 
advantage  in  noise -error  determination. 

Walsh  functions,  denoted  by  Wal  (•),  form  an  orthogonal 
basis  on  Vn  [8] , [9] . For  i £ Dn  and  x 6 Vn,  the  Hadamard- 
ordered  W alsh  functions  (10),  [ 1 1 ) , are 


n — 1 

s 


Wal(i,  x)  = (— 1)'=0 


(6) 


where  the  notation  conforms  with  that  in  (2).  Obviously, 
Wal  (i,  x)  £ (I,  — I}.  The  following  properties  can  be  readily 
verified  [8J , [12] : 


a)  Wal  (i,  x)  = Wal  (x,  i) 

(7) 

b)  2 Wal  (*,  x)  Wal  (/,  x)  = 2"6y 

(8) 

?evn 

where  5 y is  the  Kronecker  delta 

c)  Wal  (/',  x 9y)  = Wal  (/',  x)  Wal  (i,  y). 

(9) 

In  fact,  ( Vn , ®)  forms  the  dyadic  group  for  which  Walsh  func- 
tions are  the  character  functions  [8 ] . 

For  an  input  X(t)  = {(Jfn-t^),  An_2(0,  X0(t)):  for 

r £ T,  Xj(t)  € (0,  1},  for  0 < /'  < «},  where  each  X,(t)  is  a 
binary  stochastic  process,  the  output  of  a given  combinational 
circuit  S is  also  a binary  stochastic  process_{S(,Y(f))  6 {0,  1}: 
t £ T).  We  define  a distance  Ds[X(t),  Y(f))  between  the 
responses  to  two  inputs  X(t)  and  Y(t)  as  the  fraction  of  the 
time  that  the  output  S(X(t))  differs  from  S(F(f)).  If  X(t)  is  the 
signal  input  process  in  the  absence  of  noise  and  XN(t)  = 
1(7),  Xfj  n— 2(0<  30v,o(0}  ^ 7”}  ajioise- 

corrupted  input  process,  then,  in  general,  5(A"(r))  S(XN(t)) 
and  we  write  the  error  at  the  output  due  to  noise  at  the  input 


III.  EQUIVALENT  BOOLEAN  FUNCTIONS  AND  THEIR 
WALSH  REPRESENTATION 

Because  Walsh  functions  form  an  orthogonal  basis  on  Vn , 
we  can  represent  any  Boolean  function  as  a Walsh  series.  We 
write,  for  any  n-input  Boolean  function  S , 

■S(x)=  2 Wal  (f,x)  (10) 

i£Dn 

where 

b,  = 2~n  X S(x)  Wal  (t,  x).  (11) 
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Two  Boolean  functions  SjOc)  and  S2(x)  on  F n are  said  to  be 
equivalent  [13)  if  there  is  a sequence  of  permutations  and 
complementations  of  some  of  the  variables  <xn_1,xn_2> 
x0)  to  produce  yn- 2,  — , y0)  such  that,  for  every 

xevn, 

S1(y)®S2(x)  = d,  for  d € {0,  1}.  (12) 

A Assertion  1 (See  Appendix  I for  Proof) 

Let  an  n-input  Boolean  function  S(x)  as  represented  in  (10) 
be  transformed  under  an  equivalence  operation  (permutations 
or  complementations)  to 

(?(x)  = Z <7y  Wal  ft  x).  (13) 

i£Dn 

a)  If  Q(x)  is  the  complement  of  S(x),  then 

1 — b0,  for  i = 0 

~bit  for  / £Dn  — {0}  = {1,  2,  — , 2n  — 1}. 

(14) 

b)  If  out  of  x £ Vn,  the  inputs  Xj  , xi2,  — , xim, where 
m <n,  are  complemented,  then 

<?,  = bt  Wal  (i,  h)  (15) 


m 

h = £ 2'*. 

k = \ 

c)  If  xa  and  xg  (0  < n,  (?  < n)  are  interchanged,  then 


1bif  for  those  i where  ia  = ia 

(16) 

b,92a92B’  for  those  i where  ia  + i0. 

This  assertion  will  be  used  to  prove  that  the  part  of  the  error 
which  depends  only  on  noise  statistics  is  invariant  over  com- 
plementations in  Boolean  functions  and  over  an  interchange  of 
inputs  under  certain  conditions. 


IV.  NOISE  ERROR  IN  COMBINATIONAL  CIRCUIT 

We  have  defined  previously  a distance  Os[Z(r),  F(f)J 
between_  the  responses  of  a combinational  circuit  S to  the 
inputs  X(t ) and  Kft)  in  a qualitative  manner.  For  stochastic 
inputs  over  a discrete  time  domain  T, 


Ds[X(t),  Y(t)} 

= E Z [5(J(f))®5(F(r»] 

1 1 1 1ST 

where  Ds  [ •,  •)  satisfies  the  following  properties: 


a)  Ds[X(t),  F(r)J  = £>s[  Y(t),  X(t)\  > 0 (18) 

b) £)s[J(r),  J(0]  =0  (19) 

c)  T>s[F(f),  F(/)]  <DS[ X(t),  Z(t)\ 

+ Ds[Z(t),  F(f)].  (20) 

Combining  (4),  (1  and  (10),  we  have  the  following  Walsh 
representation  for  the  error  |s  at  the  output  of  the  combina- 
tional circuit  S for  signal  X(t)  corrupted  by  noise  N(t). 


Ss=E  Z Z bt  Wal  ft  X(t)) 

I 1 I ter  |_  te Dn 

_ 2 

- £ Wal  ft  XN(t)) 

iGDn 


where  the  identity  a ® b = (a  - b)2  for  a,  b 6 {0,  1}  has  been 
used.  The  following  relations  hold: 

E{[  1 - Wal  (i , JV(t))] 2}  = 2(1  — E [Wal  (i,  7V(f))] } (22) 

which  vanishes  if  i = 0;  and 

£■{[  1 - Wal  ft  N(t))]  [ 1 - Wal  (/.  N(t))] } = 0 (23) 

if  i or  j = 0.  By  using  (5),  (22),  and  (23),  we  can  put  (21)  in 
the  following  form: 

is  = is(A0  + tsW  X)  (24) 


is(A0  = — 2 Z 6,2[l-^{Wal(/,^(f))}]  (25) 

I 1 I t£T  i£Dn 

which  depends  only  on  noise,  and 


Ss(N,X)  = —-  2 Z Z bibj 

Ml  1ST  i*j:i,J<=Dn 

£■{[  1 - Wal  (i,  JV(f))]  • [ 1 - Wal  (/,  %))] 

• Wal(i®/,  X(t)))  (26) 

which  depends  on  both  signal  and  noise.  Note  that  Dn  may  be 
replaced  by  Dn  - {0}.  Equations  (24)-(26)  are  general  results 
for  system  errors. 

Under  the  complementation  operations  in  Assertion  I:  a), 
b),  which  transform  5 to  Q,  equations  (14)  and  (15)  indicate 
that  <7,2  = 6,2  for  ^ 0.  Hence,  ie(A0  = £S(A0-  Furthermore, 
using  ( 1 6)  and  (25),  we  have 


i«(A0  = 777  Z Z VI  1 ~ E (Wal  ((,  V(r))}] 

Ml  ter  ia*i„ 


+777  2 S w 

Ml  ter  ia*i0 
— £"{Wal  (i  ® 2°  ® 2**,  (V(f))}]. 
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Now,  in  view  of  (9),  if  Na(r),  Ng(t)  are  identically  distributed 
and  independent  from  the  other  noise  processes, 

E {Wal  [ /'  fi  2“  ib  2<*,  /V(r)] } 

= £{Wal[l,  A?(/)]}  .£{(-1  (2g) 

Since  exactly  one  out  of  {/Q,  j^}  will  be  I if  ia  =£/'( 3,  and  since 
(-!)"■">  and  (-1)N0<°  have  the  same  mean,  it  follows  from 
(25)  and  (27)  again  that  ^(A')  = £S(/V).  Hence,  we  can  make 
the  following  assertion. 

A.  Assertion  II 

For  a given  combinational  circuit  S,  the  noise-dependent 
error  term  £S(/V)  is  1)  invariant  under  a complementation  of 
its  Boolean  function  and/or  a complementation  of  any  subset 
of  the  inputs,  and  2)  invariant  under  an  interchange  of  inputs 
jra(r)  and  x$(t)  if  the  noise  processes  { Na(t ),  N$(t)}  are  inde- 
pendent of  [N^t):  i =£  a,  0}  and  the  probabilities  of  Na(t)  = 1 
and  of  /Vg (r)  = 1 are  equal. 

V.  ERROR  FOR  INDEPENDENT  AND 
STATIONARY  INPUTS 

The  noise-error  formulas  in  (25)  and  (26)  are  quite  involved, 
and  it  is  difficult  to  interpret  the  dependence  of  I|s(/V)  and 
{|S(/V,  X)  on  the  statistics  of  the  noise  and  the  signal.  We  shall 
now  show  that,  when  the  signal  and  noise  are  independent  and 
stationary  processes,  each  identically  distributed,  ^(A^  is 
expressible  as  a polynomial  in  the  expected  value  of  the  noise 
and  !s(Af,  X)  as  a polynomial  in  the  expected  values  of  the 
signal  and  the  noise.  Preparatory  to  the  substantiation  of  this 
statement,  we  first  need  to  establish  a lemma. 

A.  Lemma  ( See  Appendix  II  for  Proof) 

If  Xj  E (0,  1}  are  independent  and  identically  distributed 
binary  random  variables  (0  <j<n ) with  Prob  (Xj  = 1)  = 8X, 
then 

£-{Wal(r,  X)}  =(1  ~28x)Hmd)  (29) 

where  Hm(i)  denotes  the  Hamming  weight  of  /: 

n — t 

Hm(i)=  £ '>•  (30) 

i=o 

Under  the  assumption  that  the  signal  and  noise  are  inde- 
pendent and  stationary  processes,  each  identically  distributed, 
we  obtain  the  following  important  simplified  results  from  (25) 
and  (26)  immediately,  with  the  aid  of  (29). 

B.  Assertion  HI 

If  {Xi(t).  Nj (t).  0 < i < n)  are  independent  and  stationary 
with 

Prob  [*,(0=  1]  = E{X,}  = 8x  (31) 

and 

Prob  (/V,(f)  = 1 1 = E{N,}  = 8N  (32) 
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then  the  component  error  expressions  (s(Af)  and  £s(Af  X)  in 
(25)  and  (26)  for  the  Boolean  function  S represented  in  (10) 
can  be  simplified,  respectively,  to 

k(A0  = 2 2 W ~PNHm(i)]  (33) 

teon 

and 

fsW  *)  = 2 2 b,bjl  1 + pNHm 

- pNHmV)  - (34) 

where 

Px  = 1 -26*  (35) 

and 

pN  = l — 28N  (36) 

and  Dn  may  be  replaced  by  Dn  - {0}.  Note  that  £S(/V)  in  (33) 
is  a polynomial  in  the  expected  value  of  the  noise  and  that 
£s(Af,  X)  in  (34)  is  a polynomial  in  the  expected  values  of  the 
signal  and  the  noise.  Both  are  relatively  simple  to  compute  and 
their  sum  can  be  plotted  versus  8N  for  different  values  of6x 
for  a given  combinational  circuit. 

VI.  SPECIAL  SITUATIONS 

We  now  examine  the  behavior  of  the  error  for  three  special 
situations;  namely,  A)  the  low-noise  case,  B)  the  case  of 
8N  = 0.5,  and  C)  the  unbiased-signal  case. 

A.  The  Low-Noise  Case:  8 N < 1 

In  such  a case,  we  can  use  the  approximation 

PNk  = (1  - 28n)>  a 1 - 2k8N  (37) 

and  write  (33)  and  (34)  as 

Ss(N)  = 28Ne0  (38) 

and 

Is(N,X)  = 28n  ^ ekpx*  (39) 

h = 1 

where,  for  0 < k 

eh  = 22  bibj[Hm(0  + Hm(j)-Hm(i  ©/)].  (40) 

ueu„ 

Hm 

Substituting  (38)  and  (39)  in  (24),  we  have 

n 

Ss  = 2bN  2 ekPxh  (41) 

h-0 

Hence,  we  can  conclude  from  (41 ) that,  in  a low -noise  situation, 
the  error  |s  increases  approximately  linearly  with  8N.  the 
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constant  of  proportionality  being  a polynomial  in  px.  Ibis 
conclusion  is  exhibited  in  Figs.  2(a)  and  3(a).  Note  that  £s  is 
independent  of  the  signal  if,  and  only  if,  ek  = 0 for  0 < k < n. 

B.  The  Case  o/5  v = 0.5 

This  is  a case  of  very  high  noise  and,  from  (36).  pN  = 0.  We 
have 

1 + - pNHmU)  _ p^HmU) 

2,  for  / = / # 0 

= 1,  forist/'^O  (42) 

0,  for  i or  /'  or  both  = 0. 

By  substitution  of  (42)  in  (34)  and  then  combining  with  (33), 
we  obtain 

n 

is  = b(A0  + fcW  X)  = 2 ckPxk  (43) 

fe  = 0 

where 

Co  = 2 2 hi2 

i&Dn  {0> 

and 

c k ~ 2 bjbj, 

UeDn-{o} 

Hence,  is  is  a polynomial  in  px  as  in  (41).  is  is  independent 
of  signal  X(t)  if,  and  only  if,  ck  = 0 for  1 < k < n. 

C.  The  Unbiased-Signal  Case 

In  many  situations  the  signal  has  no  bias,  or  the  environment 
is  not  known;  it  would  be  reasonable  to  assume  bx  = 0.5  or 
px  = 0.  Hence  is(N,  X)  = 0 and 

?s  = !s(JV)  = 2 2 W -PNHmU))  (46) 

ieo„ 

The  error  is  then  invariant  over  each  equivalence  class. 

VII.  NUMERICAL  EXAMPLES  AND  ERROR  CURVES 

We  shall  now  apply  the  method  developed  in  the  previous 
sections  to  determine  the  error  at  the  output  of  two  combina- 
tional circuits  as  a function  of  the  expected  values  of  the  signal 
and  of  the  noise  at  the  input.  Both  the  signal  and  the  noise- 
component  stochastic  processes  are  assumed  to  be  independent 
and  stationary,  each  being  identically  distributed.  The  error 
will  be  calculated  and  plotted  versus  for  different  values 
of  bx.  Two  sets  of  error  curves  (one  set  for  a low-noise  and 
the  other  set  for  a high-noise  situation)  are  presented  for  the 
Boolean  function  of  each  combinational  circuit. 

A.  Circuit  I A Three-Input  Function:  S(x)  =x^xxxa'  + 

*2*1  V +JC2Jfl 

For  this  Boolean  function,  S(x)  = 1 for.r  6 {2.  4,  6,  7}  and 
the  vector  b.  representing  the  coefficients  bt  (i  = 0.  I , — , 7)  of 


(=  ls(A0)  ' (44) 


\<k<n.  (45) 


Ci 


U) 

O 

o 


(b) 

Fig.  2.  (a)  Low-noise  error  curve  for  circuit  1.  (b)  High-noise  error 

curve  for  circuit  1 . 


the  Walsh-series  expansion  in  ( 1 0).  is  found  by  ( 1 1 ) to  be 

b = 2_2[2  1-10-100  -1], 

In  order  to  examine  the  behavior  of  the  error  curves  in  both 
the  low-noise  and  the  high-noise  situations,  the  eh  coefficients 
in  (40)  and  the  ch  coefficients  in  (44)  and  (45)  are  computed. 

eo  = 0.75,  e,  = e3  = 0,  e2  = 0.25 

c0  = 0.50,  ci=c2=c3=0. 

is  versus  5 x curves  are  plotted  in  Figs.  2(a)  and  2(b).  It  is  seen 
that,  in  the  low-noise  range,  is  increases  almost  linearly  with 
SN  and  is  dependent  on  5X  because  e2  is  nonzero.  In  the 
entire  high-noise  range,  £5  depends  minimally  on  and 
becomes  independent  of  5X  at  SN  = 0.5,  in  agreement  with 
the  ck's  being  zero  for  k # 0.  The  error  curves  are  monotoni- 
cally  increasing,  and  thus  a maximum  uncertainty  [5N  = 0.5) 
does  not  cause  a maximum  error.  The  compactness  of  both  the 
low-noise  and  the  high-noise  error  curves  is  apparently  due  to 
the  sparseness  of  the  vector  b. 
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B Grcuit  2 A Four-Input  Function  S(x)  =x3'x2'(xl  ®x0J  + 
fx3  <BX2pCi'x0'  + (X3'  +X3 X2)XXX0 

Here, 

S(x)=  1 for*  € {1,2,  3,  4,  7,  8,  11} 
the  vector  b is 

b = 2-4[7  -1-13  3 -1  -1  -1  3 -1  -1  -1  -1 
-1  -1  -5] 

and  the  ek  and  ck  coefficients  are 

e0  = 1.250,  ex  = 0.750,  e2  = 0.250, 

e3  = —0.250,  e4  = 0 

c0  = 0.492,  cj  = 0.0312,  c2  = -0.0156, 

c3= -0.0312,  c4  =-0.0391. 

versus  SN  curves  are  plotted  in  Figs.  3(a)  and  3(b).  In  the 
low-noise  range,  ijs  increases  almost  linearly  with  6N.  The 
slope  of  the  error  curves  decreases  fairly  linearly  with  increasing 
5X;  hence,  the  low-noise  error  is  upper-bounded  by  the  6X  = 0 
line.  This  linear  dependence  on  6X  results  from  the  dominance 
of  ex  over  the  other  e*’s.  The  high-noise  curves  demonstrate 
two  phenomena:  first,  heavily  biased  signals  (6X  = 0.001, 
0.01,  0.90,  0.99)  suffer  less  error  with  greater  noise  above 
5n  = 0.5;  second,  the  value  of  5^  at  which  the  maximum 
error  occurs  increases  with  increasing  6X.  This  complicated 
behavior  is  a hallmark  of  the  absence  of,  or  having  few,  zero 
Walsh  coefficients  (6,’s). 

VIII.  CONCLUSION 

This  paper  presents  a procedure  for  analyzing  the  stochastic 
behavior  of  digital  circuits  by  the  use  of  Walsh  functions.  In 
particular,  the  error  at  the  output  of  a combinational  circuit 
caused  by  noise  is  studied  by  defining  a distance  measure 
between  the  responses  to  the  signal  and  to  the  noise-corrupted 
signal.  By  restricting  the  noise  to  be  dyadically  additive,  which 
is  perfectly  reasonable,  Walsh  representation  is  used  to  obtain 
the  error  in  terms  of  the  input  statistics.  It  is  shown  that  the 
error  can  be  expressed  as  the  sum  of  two  parts:  one  part 
depends  only  on  noise  statistics,  and  the  other  on  both  signal 
and  noise.  The  former  is  invariant  for  equivalent  Boolean  func- 
tions, if  the  noise  processes  are  independent  and  identically 
distributed.  Under  the  more  constrained  condition  of  inde- 
pendent and  stationary  noise  and  signal  processes,  each  iden- 
tically distributed,  the  error  is  a polynomial  function  of  the 
expected  values  of  signal  and  of  noise.  In  a low-noise  situation, 
the  error  increases  linearly  with  the  expected  value  of  the 
noise  at  the  input.  For  unbiased  signals,  the  error  polynomial 
is  invariant  over  each  equivalence  class.  These  properties  are 
exhibited  in  two  typical  examples. 

APPENDIX  I 

Proof  of  Assertion  I 
a)  By  hypothesis, 

Qfx)=\~S(x).  (Al) 


(b) 

Fig.  3.  (a)  Low-noise  error  curve  for  circuit  2.  (b)  High-noise  error 

curve  for  circuit  2. 


Using  ( 1 0)  and  the  fact  that  Wal  (0,  x)  = I , we  have 
Qfx)  = Wal  (0,  x)  — 2 6,  Wal  (i,  x) 


= (1  -b0)  Wal  (0,5)-  2 bj  Wal  (i,  3c).  (A2) 

IGD„-{o} 

Comparison  of  (A2)  with  (13)  proves  (14). 

b)  Complementing  the  m inputs  changes  x to  y = x ® h, 
with  h given  by  ( 1 5a),  which  implies  hik  = 1 for  all  k.  As  a 
result, 

Q(x)  = S(y)  = S(xs>h) 

= 2 Wal  (i.x^h) 

i<=Dn 

= X [*(  Wal  (i,  b)]  Wal  (i,  x)  (A3) 

iSD„ 

from  which  (15)  follows  directly. 
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c)  Interchanging  xa  and  x0  changes  x to  y and 


Combining  (A5)  and  (A6),  we  have 


<2(3e)  = 5Cv)=  2 Wal  (i.y) 

‘a-‘0 


FlWal  (i,  J)]  = Prob  [Wal  (i,  X)  = 1] 

-Prob  [Wal(i,  J)  = -l] 


+ 2 *fWal(i,>).  (A4) 

(cl)  If  ia  = if,  Wal  (i,  y)  = Wal  (i,  x).  Thus  q,  = 

(c2)  If  i'a  =£  iff,  then  for / = i ® 2°  ® 2^,/'a  #=  jff. 

We  have  Wal  (i,  j>)  = Wal  (/,  3c),  and  Wal  (/,  y)  = Wal  (i,  x). 
Thus, 

^i»2a»2^' 


= > ( -6x)Hm(0-u> 

w -0  \ W / 

= (1 -26x)*'"«>  (A7) 

which  is  (29),  the  lemma  to  be  proved. 
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